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SYSTEM AND METHOD FOR 
PRE-PROCESSING A VIDEO SIGNAL 



PRIORITY 

This application claims priority from co-pending provisional U.S. Patent Application 
Serial Number 60/147,668, filed August 6, 1999, entitled "GRAPHICS WORKSTATION" and 
bearing attorney docket number 1247/A43, the disclosure of which is incorporated herein, in its 
entirety, by reference and co-pending provisional U.S. Patent Application Serial Number 
60/147,609, filed August 6, 1999, entitled "DATA PACKER FOR GRAPHICAL 
WORKSTATION" and bearing attorney docket number 1247/ A44, the disclosure of which is 
incorporated herein, in its entirety, by reference. 

CROSS REFERENCE TO RELATED APPLICATIONS 

This application is related to U.S. Patent Application Serial Number xx/xxx,xxx, filed on 
even date herewith, entitled "WORKSTATION FOR PROCESSING AND PRODUCING A 
VIDEO SIGNAL" and bearing attorney docket number 1247/A52, naming Jeff S. Ford, Claude 
Denton, Jeff Belote, and David J. Stradley as inventors, the disclosure of which is incorporated 
herein, in its entirety, by reference, U.S. Patent Application Serial Number xx/xxx,xxx, filed on 
even date herewith, entitled "SYSTEM AND METHOD FOR PRODUCING A VIDEO 
SIGNAL" and bearing attorney docket number 1247/A54, naming Jeff S. Ford and Claude 
Denton as inventors, the disclosure of which is incorporated herein, in its entirety, by reference, 
U.S. Patent Application Serial Number xx/xxx,xxx, filed on even date herewith, entitled 
"VIDEO CARD WITH INTERCHANGEABLE CONNECTOR MODULE" and bearing 
attorney docket number 1247/A55, naming Jeff S. Ford and Jeff Belote as inventors, the 
disclosure of which is incorporated herein, in its entirety, by reference, U.S. Patent Application 
Serial Number xx/xxx,xxx, filed on even date herewith, entitled "SYSTEM AND METHOD 
FOR FRAME RATE MATCHING" and bearing attorney docket number 1247/ A58, naming Jeff 
S. Ford as inventor, the disclosure of which is incorporated herein, in its entirety, by reference, 
and U.S. Patent Application Serial Number xx/xxx,xxx, filed on even date herewith, entitled 
"SYSTEM AND METHOD FOR PACKING AND UNPACIONG VIDEO DATA" and bearing 
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attomey docket number 1247/A59, naming Jeff S. Ford, Arthur McKinney and Craig Jordan as 
inventors, the disclosure of which is incorporated herein, in its entirety, by reference. 

FIELD OF THE INVENTION 

The invention generally relates to a video graphics workstation and, more particularly, the 
invention relates to the pre-processing of a video signal. 

BACKGROUND OF THE INVENTION 

In general, a video graphics workstation is a system of hardware and software that allows 
S a user to process a video signal for use in a number of different applications. For example, the 

user may process a video signal for display on a computer monitor, for storage on a computer- 
flJ readable storage medium, for display on a television, or for storage on a video tape. 
j[o Typically, however, video graphics workstations are designed to process particular video 

signals. Thus, most video graphics workstations are not scalable. In other words, most video 
□ graphics workstations are not designed to adapt to the changing needs of the workstation's user. 

f SUMMARY OF THE INVENTION 

□5 In accordance with one aspect of the invention, a method and system for pre-processing 

video signals comprises a video input module, a first video pipeline, and a second video pipeline. 
The video input module receives and forwards one or more Uve video signals, producing a 
forwarded video signal for each received Uve video signal. The first video pipeline pre-processes 
VSi, wherein VSj is a first stored video signal or one of the forwarded video signals produced in 
20 the video input module, producing a first pre-processed video signal. The second video pipeline 
pre-processes VS2, wherein VSj is the same video signal being pre-processed in the first video 
pipeline, one of the other forwarded video signals produced in the video input module, or a 
second stored video signal, producing a second pre-processed video signal. 
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In a further embodiment of the invention, the video input module may further comprise 
an ancillary data extractor, the extractor removing ancillary data from at least one of the live 
video signals converted in the video input module. 

In alternate embodiments of the invention, the received live video signal may be an 
analog composite video signal, an analog component video signal, a serial digital composite 
video signal, a serial digital component video signal, a parallel digital composite video signal, or 
a parallel digital component video signal. In addition, at least one of the pre-processed video 
signals may be an RGB encoded video signal, an RGBA encoded video signal, a YUV-Type 
encoded video signal, or a YUVA-Type encoded video signal. Further, the formatted video 
signal may include color data, alpha data, or color and alpha data. 

In further alternate embodiments of the invention, the first pre-processed video signal 
may be output to a storage medium and the second pre-processed video signal may be forwarded 
to a video graphics processor. Or, the first pre-processed video signal may be output to a storage 
medium and the second pre-processed video signal may be forwarded to a video output system. 
Or, the first pre-processed video signal may be forwarded to a video graphics processor and the 
second pre-processed video signal may be forwarded to a video output system. 

In still further alternate embodiments of the invention, the process of pre-processing may 
include changing the sample rate of the video signal being pre-processed, gamma removal, 
gamma insertion, color space conversion, dithering, and scaling. In addition, the process of pre- 
processing may include addressing on a frame-by-frame basis the video signal being pre- 
processed. Further, the video input system may be a Peripheral Component Interconnect circuit 
board. 

BRIEF DESCRIPTION OF THE DRAWINGS 

The foregoing and other objects and advantages of the invention will be appreciated more 
fully from the following further description thereof with reference to the accompanying drawings 
wherein: 
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Figure 1 shows a block diagram of an exemplary video graphics workstation for 
implementing the various embodiments of the invention. 

Figures 2a through 2b show various exemplary embodiments for a video input system for 
use in a video graphics workstation. 

Figure 3 shows an exemplary embodiment for a scalable video input system for use in a 

video graphics workstation. 

Figures 4a and 4b show various exemplary exploded views for mounting an 
interchangeable connector module to a video processing module. 

Figure 5 shows an exemplary embodiment for a video output system for use in a video 
graphics workstation. 

Figure 6 shows an exemplary embodiment for a scalable video output system for use in a 

video graphics workstation. 

Figures 7a through 7g show various exemplary video graphics applications carried out on 

an exemplary video graphics workstation. 

Figure 8 shows an exemplary process in a video graphics workstation for video signal 

frame rate matching. 

Figures 9a and 9b show an exemplary process in a video graphics workstation for packing 
and unpacking pixels. 

DETAILED DESCRIPTION OF THE INVENTION 

In accordance with one embodiment of the invention, a video graphics workstation 
includes three sub-systems-a video input system, a video graphics processor, and a video output 
system, hi general, the video input system pre-processes video signals, the video graphics 
processor processes and/or displays video signals and graphics input, and the video output system 
produces video signals. The video signals processed and produced may be analog video signals 
or digital video signals. 
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Figure 1 shows a block diagram of an exemplary video graphics workstation for 
implementing the various embodiments of the invention. Video graphics workstation 100 
includes central processing unit 102, chipset 104, memory 106, two Peripheral Component 
Interconnect ("PCF') buses--a 64-bit PCI bus and a 32-bit PCI bus, and an Accelerated Graphics 
Port ("AGP"). Video input system 1 10 and storage medium 120 connect to chipset 104 via the 
64-bit PCI bus. Video graphics processor 130 connects to chipset 104 via the AGP. Video 
output system 140 connects to chipset 104 via the 32-bit PCI bus. In addition, video input 
system 1 10 connects to video graphics processor 130 via local bus 182 and video output system 
140 connects to video graphics processor 130 via local bus 184. 

A. Video Input System 

Figures 2a through 2b show various exemplary embodiments for video input system 1 10. 
In particular, Figure 2a shows an exemplary embodiment for pre-processing a live video signal in 
video input system 110. The process of pre-processing a video signal includes, among other 
things, up sampUng, down sampling, ganuna insertion, gamma removal, color space conversion, 
scaling and dithering. For purposes of understanding and reference, and without intending to 
limit the meaning the above-identified processes have to a person of ordinary skill in the art, 
listed below are definitions for the above-identified processes: 



PROCESS 


DEFINITION 


Up Sampling 


Process of increasing the amount of 
digital data used to represent an image 


Down Sampling 


Process of decreasing the amount of 
digital data used to represent an image 


Gamma Insertion 


Process of inserting a value to 
compensate for the non-linear 
characteristics of an output device 
(e.g.. a computer monitor) 



1247-A53-124004 
August 3, 2000 



-6- 



PROCESS 


DEFINITION 


Gamma Removal 


Process of removing a value inserted to 
compensate for the non-linear 
characteristics of an output device 
(e.g., a computer monitor) 


Color Space 
Conversion 


Process of converting between 
different color encoding schemes (e.g., 
between a component color scheme 
and a composite color scheme) 


Scaling 


Process of changing the resolution of 
an image 


Dithering 


Process of combining colors to trick 
the eye into seeing more colors than 
the system can actually display 



^ In addition, pre-processing may include addressing on a frame-by-frame basis the video 

signal being pre-processed. In video, a frame is a single complete image. In frame-by-frame 
CI addressing, video input system 110 may pre-process one frame of a video signal different than, 

f := for example, the next frame of the video signal. 

%25 In the embodiment shown in Figure 2a, video input system 1 10 includes video input 

Q module 200, input multiplexer 212, input multiplexer 222, pipeline 210, pipeline 220, output 

multiplexer 214, and output multiplexer 224. Video input module 200 receives a live video 
signal and forwards the live video signal to, for example, a buffer (not shown) for transfer to 
pipehne 210 and/or pipeline 220. The live video signal may be an analog video signal or a 
20 digital video signal. If the live video signal is an analog video signal, then video input module 
200 converts the live video signal into a computer-readable format. 

The input multiplexers, multiplexer 212 and multiplexer 222, route the respective video 
signal to the pipelines. In particular, multiplexer 212 routes video signals to pipeline 210 and 
multiplexer 222 routes video signals to pipeline 220. The pipeUnes, pipeline 210 and pipeline 
25 220, pre-process the forwarded video signal The output multiplexers, multiplexer 214 and 
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multiplexer 224, route the pre-processed video signals to, for example, various output buffers 
(not shown) accessible to video graphics workstation 100. For example, the pre-processed video 
signal may be forwarded, via the 64-bit PCI bus and the AGP, to video graphics processor 130. 
Or, the pre-processed video signal may be forwarded, via the 64-bit PCI bus and the 32-bit PCI 
bus, to video output system 140. The pre-processed video signal may also be forwarded, via the 

10 64-bit bus, to storage medium 120. 

Figure 2b shows an exemplary embodiment for pre-processing a live video signal and a 
stored video signal in video input system 1 10. In this embodiment, pipeline 210 and pipeline 220 
pre-process a live video signal and/or a stored video signal. Typically, the stored video signal is 

'i forwarded from, for example, storage medium 120, to a buffer (not shown) to allow for efficient 

15 transfer of the stored video signal to video input system 110. 

^ With two pipelines, a single live, or stored, video signal may reach pipeline 210 and 

^ pipeline 220. Thus, two versions of a single live, or stored, video signal may be generated at the 

J same time. For example, video input system 110 may receive a television signal and pre-process 

the televison signal via pipeline 210 for display on a computer monitor and via pipeline 220 for 

lO storage on storage medium 120. In addition, using frame-by-frame addressing, video input 

system 1 10 may pre-process more than two video signals substantially at the same time. In this 

t embodiment, the frames of the different video signals are interleaved and routed to pipeline 210 

and pipeline 220. Moreover, video input system 1 10 may pass a video signal, either live or 
stored, through pipeline 210 and/or pipeline 220 without pre-processing the video signal. 

25 In a further embodiment of video input system 110, video input module 200 receives and 

forwards more than one Uve video signal to, for example, a buffer (not shown) for transfer to 
pipeline 210 and/or pipeline 220. The live video signals may be analog video signals or digital 
video signals. If the live video signal is an analog video signal, then video input module 200 
converts the live video signal into a computer-readable format. For each received live video 

30 signal, video input module 200 produces a forwarded video signal. 
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In a further embodiment of these exemplary embodiments, video input module 200 
includes an ancillary data extractor for removing ancillary data from a live video signal. 
Typically, the ancillary data is removed from the live video signal prior to receipt of the live 
video signal in the input multiplexers, multiplexer 212 and multiplexer 214. Ancillary data 
includes, among other things, audio data and close captioning data. 
10 Figure 3 shows an exemplary embodiment for a scalable video input system 110. In this 

embodiment, video input system 1 10 includes video input module 300 and video processing 
module 350. Video input module 300 includes receiver 302, processor 304, and buffer 306. 
Receiver 302 receives a live video signal and forwards the live video signal to processor 304. 
i Processor 304 converts the received video signal into a video signal having a common video data 

15 format. The formatted video signal is then forwarded to buffer 306 for transfer to video 
j processing module 350. In alternate embodiments of the invention, video input module 300 may 

^ include an ancillary data extractor for removing ancillary data from a live video signal. 

J Video processing module 350 includes input multiplexer 352, pipeUne 354, and output 

] multiplexer 356. As discussed above in regard to the embodiments shown in Figure 2, video 

^0 processing module 350 pre-processes the formatted video signal and/or a stored video signal and 
= routes the pre-processed video signal to, for example, a buffer (not shown) accessible to video 

3 graphics workstation 100. Video processing module 350 may have two pre-processing pipelines. 

In addition, the pre-processed video signal may be forwarded to video graphics processor 130, 
video output system 140, and/or storage medium 120. 
25 The common video data format may be an organized bit stream. As noted above, a frame 

is a single complete image. An image, in turn, is composed of a raster of picture elements, 
referred to as pixels. A pixel is represented by some number of bits stored, for example, in 
memory. Pixels are the smallest "units" on a screen that can be given a color (represented with 
color data) and an opacity (represented with alpha data). Thus, an organized bit stream may 
30 include color data, alpha data, or color data and alpha data. For example, a bit stream with color 
data may include 20-bits for color data. In contrast, a bit stream for alpha data may include 10- 
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bits for alpha data. Pipeline 354 may pre-process color data separate from alpha data. In this 
embodiment, a color data bit stream may be forwarded on a output different from the output used 
to forward alpha data. 

In these exemplary embodiments, video input module 300 and video processing module 
350 are separate modules coupled together via, for example, male/female cables. In one 
10 embodiment, video input module 300 is a daughterboard that plugs into video processing module 
350. The separation of the various functions of a video input system into a video input module 
and a video processing module allows for the separation of video input module 300 and video 
processing module 350. 

!^ In turn, the separation of video input module 300 from video processing module 350 

15 allows for the configuration of various video input modules, each configured to receive and 
1 process different video signal formats. Because the "input" functions of video input system 1 10 

,^ have been separated from the "processing" functions of video input system 1 10, video input 

J module 300 may be "exchanged" without the need to replace video processing module 350. 

] Thus, when a user wants to input, for example, a serial digital component video signal into video 

20 input system 1 10 instead of an analog composite video signal, the user "exchanges" the video 
= input module configured for the analog composite video signal with a video input module 

] configured for the serial digital component video signal In turn, processor 304 (on the "new" 

video input module) signals video processing module 350 of the new configuration. 
Figures 4a and 4b show various exemplary exploded views for mounting an 
25 interchangeable connector module, such as video input module 300, to a processing module, such 
as video processing module 350. In Figure 4a, interchangeable connector module 400 includes 
connectors 402 and mounting holes 404. Circuit board 450 includes plate 455. Plate 455 
includes connector holes 452 and mounting holes 454. Plate assembly 430 includes plate 435a 
and two screws (not shown). Plate 435a includes connector holes 432a and mounting holes 
30 434a. Connectors 402 are designed to fit through connector holes 432 and 452. The two screws. 
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passing through mounting holes 434a and mounting holes 454, secure interchangeable connector 
module 400 to circuit board 450 via mounting holes 404. 

In Figure 4b, plate assembly 430 further includes plate 435b and gaskets 436. Gaskets 
436 are designed to improve electromagnetic shielding. For example, gaskets 436 may be 
composed of a rubber compound v^ith embedded silver. For the exemplary embodiments shown 
10 in both Figure 4a and Figure 4b, in operation, interchangeable connector module 400 would also 
be coupled (not shown) to processing module 450. 

B. Video Graphics Processor 

Various exemplary embodiments of a video graphics processor are disclosed in the 
■7; following: 

015 1. U.S. Patent Application Serial No. 09/353,495, filed July 15, 1999, and entitled 

fjj "MUUriPROCESSOR GRAPHICS ACCELERATOR," the disclosure of which is hereby 

%1 incorporated, in its entirety, by reference; 

OJ 2. U.S. Patent Application Serial No. 09/354,462, filed July 15, 1999, and entitled 

p "APPARATUS AND METHOD OF DIRECTING GRAPHICAL DATA TO A DISPLAY 

S^O DEVICE," the disclosure of which is hereby incorporated, in its entirety, by reference; 
£ 3. U,S. Patent Application Serial No. 09/353,420, filed July 15, 1999, and entitled 

a "WIDE INSTRUCTION WORD GRAPHICS PROCESSOR," the disclosure of which is hereby 

incorporated, in its entirety, by reference; and 

4. U.S. Patent Application Serial No. 09/353,419, filed July 15, 1999, and entitled 
25 "SYSTEM FOR DISPLAYING A TELEVISION SIGNAL ON A COMPUTER MONITOR," 
the disclosure of which is hereby incorporated, in its entirety, by reference. 

C. Video Output System 

Figure 5 shows an exemplary embodiment for video output system 140. In Figure 5, 
video output system 140 includes receiver 500, pipeline 510, and video output module 520. 
30 Receiver 500 receives a video signal and forwards the received video signal to, for example, a 
buffer (not shown) for transfer to pipeline 510. The received video signal may be formatted in 
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one of many different video data formats. For example, the received video signal may be an 
RGB encoded video signal or an RGBA encoded video signal. An RGB encoded video signal 
encodes an image in accordance with the amount of red, green, or blue contained in the image. 
An RGBA encoded video signal further encodes an image in accordance with the amount of 
opacity contained in the image. 
10 The received video signal may also be a "YUV-Type" encoded video signal or a "YUVA- 

Type" encoded video signal. A "YUV-Type" encoded video signal encodes an image in 
accordance with the amount of luma (black and white) and color differences contained in the 
image. A "YUVA-Type" encoded video signal further encodes an image in accordance with the 
% amount of opacity contained in the image. A "YUV-Type" encoded video signal includes, 

Of 5 among other things, a YUV encoded video signal, a YCbCr encoded video signal, and a YPbPr 
nJ encoded video signal. A "YUVA-Type" encoded video signal includes, among other things, a 

^1 YUVA encoded video signal, a YCbCrA encoded video signal, and a YPbPrA encoded video 
signal. 

n Pipeline 510 post-processes the forwarded video signal and forwards the post-processed 

p20 video signal to video output module 520. The process of post-processing includes, among other 
1: things, region of interest selection, frame rate matching, spatial adaptation, up sampling, down 
£j sampling, gamma insertion, ganrnia removal, and color space conversion. Spatial adaptation 

includes, among other things, scaling and picture framing. Picture framing includes, among 
other things, letter boxing. For purposes of understanding and reference, and without intending 
25 to limit the meaning the above-identified processes have to a person of ordinary skill in the art, 
listed below are definitions for the above-identified processes not previously defined: 



PROCESS 


DEFINITION 


Region of Interest 
Selection 


Process of selecting a portion of an 
image for post-processing 


Frame Rate 
Matching 


See Section E. 
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PROCESS 


DEFINITION 


Picture Framing 
and Letter Boxing 


Process of positioning an image on a 
background image 



In addition, post-processing may include addressing on a frame-by-frame basis the video 
signal being post-processed. In frame-by-frame addressing, video output system 140 may post- 
10 process one frame of a video signal different than, for example, the next frame of the video 

signal. Also, post-processing may include changing a frame of video data into interlaced fields 
of video data. In using this process, video output system 140 "blends" single or multiple lines 
from a frame in an input video signal into a single line in an output video signal, e.g. , 3:2 puU- 
^ down. 

fjyS Video output module 520 converts the post-processed video signal to a formatted video 

^ signal. The formatted video signal may be an analog video signal or a digital video signal. 

Typically, video output system 140 also includes a generator locking device, referred to 

^ as a genlock, v^hich allows the synchronized display of graphics and video. A genlock may lock 

video output system 140 to, for example, video graphics processor 130. In addition, regardless of 

^ whether video output system 140 is locked to video graphics processor 130, a genlock may lock 

f J video output module 520 to another source, e^, an external clock, an internal clock, etc. 

In a further embodiment of these exemplary embodiments, video output module 520 
includes an ancillary data injector for inserting ancillary data into the post-processed video signal 
prior to conversion of the post-processed video signal. As noted above, ancillary data includes, 

25 among other things, audio data and close captioning data. 

Figure 6 shows an exemplary embodiment for a scalable video output system 140. In this 
embodiment, video output system 140 includes video processing module 600 and video output 
module 650. Video processing module 600 includes receiver 602 and pipeline 604. As 
discussed above in regard to the embodiments shown in Figure 3, video processing module 600 

30 receives a video signal, post-processes the received video signal, and forwards the post-processed 
video signal to video output module 650. Video processing module 600 may include a generator 
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locking device for locking video processing module 600 to, for example, video graphics 
processor 130. 

Video output module 650 includes buffer 652, processor 654, and transmitter 656. Video 
processing module 600 forwards the post-processed video signal to buffer 652 for transfer to 
processor 654. Processor 654 converts the post-processed video signal into a formatted video 

10 signal, e^, an analog composite video signal, a parallel digital component video signal, etc. The 
formatted video signal is then forwarded to transmitter 656. In alternate embodiments of the 
invention, video output module 650 may include an ancillary data injector for inserting ancillary 
data into the post-processed video signal. 

'^^f In these exemplary embodiments, video output module 650 and video processing module 

Cil5 600 are separate modules coupled together via, for example, male/female cables. In one 

n i embodiment, video output module 650 is a daughterboard that plugs into video processing 

module 600. The separation of the various functions of a video output system into a video output 

ni module and a video processing module allows for the separation of video output module 650 and 

Q video processing module 600. 

In turn, the separation of video output module 650 from video processing module 600 

4" allows for the configuration of various video output modules, each configured to process and 

O produce different video signal formats. Because the "output" functions of video output system 
140 have been separated from the "processing" functions of video output system 140, video 
output module 650 may be "exchanged" without the need to replace video processing module 

25 600. Thus, when a user wants to output, for example, a serial digital component video signal 
instead of an analog composite video signal, the user "exchanges" the video output module 
configured for the analog composite video signal with a video output module configured for the 
serial digital component video signal. In turn, processor 354 (on the "new" video output module) 
signals video processing module 600 of the new configuration. 

30 As an interchangeable connector module, video output module 650 may be mounted on 

video processing module 600, a processing module, in the manner shown in Figures 4a and 4b. 
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D. Exemplary Video Graphics Applications 

Figures 7a through 7g show various exemplary video graphics applications carried out on 
an exemplary video graphics workstation implementing one embodiment of the invention. In 
this embodiment, video input system 730 includes two pipelines, pipeline 732 and pipeline 734. 
In addition, video output system 750 forwards a formatted video signal to a video tape recorder 
for recordation. 

In Figure 7a, video graphics workstation 700 captures a live video signal. First, video 
graphics workstation 700 receives the live video signal. Next, the received video signal is pre- 
processed in pipeline 732 of video input system 730. Then, the pre-processed video signal is 
forwarded, via the 64-bit PCI bus, to storage medium 720. 

In Figure 7b, video graphics workstation 700 captures and displays a live video signal. 
First, video graphics workstation 700 receives the live video signal. Next, the received video 
signal is pre-processed in both pipeline 732 and pipeline 734 of video input system 730. Then, 
the pre-processed video signal from pipeline 732 is forwarded, via the 64-bit PCI bus, to storage 
medium 720. In the interim, the pre-processed video signal from pipeline 734 is forwarded, via 
local bus 782, to video graphics processor 740 for display on computer monitor 760. The pre- 
processed video signal from pipeline 734 may also be forwarded to video graphic processor 740 
via the 64-bit PCI bus and the AGP. In alternate embodiment, the pre-processed video signal 
from pipeline 734 may be forwarded, via the 64-bit bus and the 32-bit bus, to video output 
system 750 for recordation on video tape recorder 770. 

In Figure 7c, video graphics workstation 700 plays back a stored video signal. First, 
video graphics workstation 700 forwards a stored video signal, via the 64-bit PCI bus to video 
input system 730. Next, the stored video signal is pre-processed in pipeline 732. Then, the pre- 
processed video signal is forwarded, via local bus 782, to video graphics processor 740 for 
display on computer monitor 760. In an alternate embodiment, the pre-processed video signal 
may also forwarded, via local bus 784, to video output system 750 for recordation on video tape 
recorder 770. 
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In Figure 7d, video graphics workstation 700 processes a stored video signal, for 
example, performs a two-dimensional or three-dimensional effect on the stored video signal, and 
displays the processed video signal. First, video graphics workstation 700 forwards a stored 
video signal, via the 64-bit PCI bus, to video input system 730. Next, the stored video signal is 
pre-processed in pipeline 732. Then, the pre-processed video signal is forwarded, via local bus 
10 782, to video graphics processor 740 for "effects" processing and display on computer monitor 
760. In an alternate embodiment, the processed video signal may also forwarded, via local bus 
784, to video output system 750 for recordation on video tape recorder 770. 

In Figure 7e, video graphics workstation 700 pre-processes a stored video signal and 
saves the pre-processed video signal. First, video graphics workstation 700 forwards a stored 
m video signal, via the 64-bit PCI bus, to video input system 730. Next, the stored video signal is 
SI pre-processed in pipeline 732. Then, the pre-processed video signal is forwarded, via the 64-bit 
Mi PCI bus, to storage medium 720. In alternate embodiments, the pre-processed video signal may 
fy be forwarded, via the 64-bit PCI bus, to central processing unit 7 1 5 or to memory 710. 
p In Figure 7f, video graphics workstation 700 processes a stored video signal and saves the 

Ho processed video signal. First, video graphics workstation 700 forwards a stored video signal, via 
4= the 64-bit PCI bus, to video input system 730. Next, the stored video signal is pre-processed in 
n pipeline 732. Then, the pre-processed video signal is forwarded, via local bus 782, to video 

graphics processor 740 for "effects" processing. Last, the processed video signal is forwarded, 
via local bus 782, to video input system 730. Video input system 730 may pre-process the 
25 processed video signal, for example, to convert the processed signal to a format better suited for 
saving, or forward the processed signal, via the 64-bit PCI bus, to storage medium 720. 

In Figure 7g, video graphics workstation 700 combines a live video signal, a stored video 
signal, and graphics information and records the combined video signal. First, video graphics 
workstation 700 receives a live video signal. Next, the received video signal is pre-processed in 
30 pipeline 732 of video input system 730. In the interim, video graphics workstation 700 forwards 
a stored video signal to video input system 730. Next, the stored video signal is pre-processed in 
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pipeline 734. Then, graphics information (via the AGP), the pre-processed video signal from 
pipeline 732 (via local bus 782), and the pre-processed video signal from pipeline 734 (via local 
bus 782) are forwarded to video graphics processor 740 for "effects" processing. Last, the 
processed video signal is forwarded, via local bus 784, to video output system 750 for 
recordation on video tape recorder 770. 
10 E. Frame Rate Matching 

As discussed above, a frame is a single complete image. Typically, a frame is 
represented, in a video graphics workstation, with frame data. In general, frame rate is how fast a 
new frame of frame data, in other words, an new image, is available for processing or display. 
The process of frame rate matching includes, among other things, matching the frame rate of, for 
3.15 example, a video signal to the frame rate of, for example, an output device. Typically, in a video 
m graphics workstation, the process of frame rate matching occurs in the video output system. 
%1 Figure 8 shows an exemplary process in a video graphics workstation for video signal 

nj frame rate matching. The process begins at step 800, in which the video graphics workstation 
Q fills a first buffer with a sequence of fi-ame data. Next, at step 810, the workstation reads out the 
So frame data in the first buffer and, at substantially the same time, fills a second buffer with the 
4^ next sequence of frame data. The process continues at step 820, in which the video graphics 
C] workstation determines whether all of the frame data has been read out of the first buffer. If yes, 
the video graphics workstation fills the first buffer with the next sequence of frame data. If no, 
the video graphics workstation, at step 830, fills the third buffer with the next sequence of frame 
25 data. 

Next, at step 840, the video graphics workstation determines whether all of the frame data 
in the first buffer has been read out of the first buffer. If no, the video graphics workstation 
begins to fill the second buffer with the next sequence of frame data. If yes, the video graphics 
workstation, at step 850, determines whether the second buffer or the third buffer has the most 
30 current and most complete frame data. If the second buffer has the most current and most 

complete frame data, the video graphics workstation, at step 860, reads the frame data out of the 
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second buffer. If the third buffer has the most current and most complete frame data, the video 
graphics workstation, at step 870, reads the frame data out of the third buffer. 

In a further embodiment of the invention, the buffer determined not to have been filled 
with the most current and most complete frame data becomes a remainder buffer. In this 
embodiment, the video graphics workstation fills the remainder buffer with the next sequence of 

10 frame data. Then, if all of the frame data has not been read out of the buffer determined to have 
been filled with the most current and most complete frame data, the video graphics workstation 
fills the first buffer with the next sequence of frame data. The video graphics workstation 
continues to alternate between the remainder buffer and the first buffer until all of the frame data 

Cf has been read out of the buffer determined to have been filled with the most current and most 

iJB complete frame data. 

Thus, in operation, the three buffers change "roles." For example, the buffer now being 
filled may, depending upon the circumstances, next become either the buffer being read or the 

pj buffer not being either filled or read. Or, the buffer now being read may, depending upon the 

n circumstances, next become either the buffer being filled or the buffer not being either filled or 
read. Or, the buffer now not being either filled or read may, depending upon the circumstances, 

4^ next become either the buffer being read or the buffer being filled. 

In both embodiments of the invention, a buffer may contain the most complete frame data 
when the buffer is less than 100% full Typically, however, a buffer contains the most complete 
frame data when the buffer is 100% full. In addition, a buffer may contain one or more frames of 

25 frame data. Typically, however, a buffer contains one frame of frame data. 

Further, both embodiments of the invention are scalable. In other words, both 
embodiments of the invention may be used to match any frame rates. For example, a frame rate 
to be matched may be 24/1.001 frames/second, or 24 frames/second, or 25 frames/second, or 
29.97 frames/second, or 30/1.001 frames/second, or 30 frames/second, or 50 frames/second, 

30 60/1.001 frames/second, 60 frames/second or 75 frames/second. Also, the frame rates being 
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matched may be the same frame rate. Or, in the alternative, the frame rates being matched may 
be multiples of each other. 

F. Packing and Unpacking Video Data 

As discussed above, an image is composed of a raster of picture elements, referred to as 

pixels. Pixels are the smallest "units" on a screen that can be given a color (represented with 
10 color data) and an opacity (represented with alpha data). In general, a pixel is represented by 

some number of bits stored, for example, in memory. For example, a pixel may be 1-bit in 

length, 8-bits in length, 10-bits in length, 24-bits in length, or 32-bits in length. 

In turn, memory stores data in segments, with each segment being some number of bits. 

For example, memory may be capable of storing data in 32-bit segments or 64-bit segments. It 
Cr6 may inefficient, however, to store, for example, one 8-bit pixel in a 32-bit memory segment. But, 
m four 8-bit pixels may be "packed" in a 32-bit memory segment. In the same way, four 24-bits 
"i: pixels may be packed in three 32-bit memory segments. Typically, in a video graphics 
ilJ workstation, the process of packing and unpacking pixels occurs in the video input system, 
rj Figures 9a and 9b show an exemplary process in a video graphics workstation for packing 

^ and unpacking pixels. In particular. Figure 9a shows an exemplary process in a video graphics 
4S workstation for unpacking pixels. The process begins at step 900a, in which the video graphics 
□ workstation loads a shift-down register with the pixel data contained in a first memory device. In 

this embodiment, the first memory device has a bit storage capacity smaller in size than the bit 

storage capacity of the shift-down register. For example, the first memory device may be 64-bits 
25 in length and the shift-down register may be 80-bits in length. Next, at step 910a, the video 

graphics workstation shifts one complete pixel of pixel data down the shift-down register. For 

example, one 24-bit pixel is shifted down the shift-down register. 

Then, at step 920a, the video graphics workstation determines whether the shift-down 

register contains another complete pixel of pixel data. If yes, the video graphics workstation 
30 shifts another complete pixel of pixel data down the shift-down register. If no, the video 

graphics workstation, at step 930a, loads a shift-up register with the pixel data contained in a 
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second memory device. In this embodiment, the second memory device is contiguous with the 
first memory device and has the same bit storage capacity as the first memory device. Also, the 
shift-up register has the same bit storage capacity as the shift-down register. 

Next, at step 940a, the video graphics workstation shifts the pixel data in the shift-up 
register up the number of bits of pixel data remaining in the shift-down register. For example, if 

10 the shift-down register has 16 bits of pixel data remaining, then the video graphics workstation 
shifts the pixel data in the shift-up register up 16 bits. Then, at step 950a, the video graphics 
workstation moves the pixel data in the shift-up register to the shift-down register, placing the 
shifted-up pixel data in the same bit locations in the shift-down register the shifted-up pixel data 

y occupied in the shift-up register. For example, if the shifted-up pixel data occupied bit locations 
16 through 63 in the shift-up register, then the video graphics workstation moves the shifted-up 

m pixel data to bit locations 16 through 63 in the shift-down register. 

^ Figure 9b shows an exemplary process in a video graphics workstation for packing pixels. 

In this embodiment, the memory device in which the pixel data will be packed has a bit storage 
a capacity smaller in size than the bit storage capacity of the shift-up register. For example, the 
So memory device may be 64-bits in length and the shift-up register may be 80-bits in length. 
4= The process begins at step 900b, in which the video graphics workstation shifts one 

5 complete pixel of data up a shift-up register. Next, at step 910b, the video graphics workstation 
determines whether the shift-up register has capacity to hold another complete pixel of pixel data. 
If yes, the video graphics workstation shifts another complete pixel of pixel data up the shift-up 
25 register. If no, the video graphics workstation, at step 920b, moves the pixel data in the 

uppermost bit locations of the shift-up register to a shift-down register, placing the moved pixel 
data in the same bit locations in the shift-down register the moved pixel data occupied in the 
shift-up register. For example, if the moved pixel data occupied bit locations 16 through 63 in 
the shift-up register, then the video graphics workstation moves the shifted-up pixel data to bit 
30 locations 16 through 63 in the shift-down register. 
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The amount of pixel data moved from the uppermost bit locations in the shift-up register 
depends upon the bit storage capacity of the memory device in which the pixel data will be 
packed. For example, if the memory device is 64-bits in length, then the video graphics 
workstation moves the 64 uppermost bits of the shift-up register to the shift-down register. Also, 
the shift-down register has the same bit storage capacity as the shift-up register. 

10 Next, at step 930b, the video graphics workstation shifts the pixel data in the shift-down 
register down the number of bits of pixel data remaining in the shift-up register. For example, if 
the shift-up register has 16 bits of pixel data remaining, then the video graphics workstation 
shifts the pixel data in the shift-down register down 16 bits. Then, at step 940b, the video 

11 graphics workstation moves the contents of the shift-down register to the memory device. 

WB In all embodiments of the invention, one complete pixel of pixel data may include a bit 

^ j stream of color data, a bit stream of alpha data, or a bit stream of color data and alpha data. The 
%1 color data may be RGB encoded or "YUV-Type" encoded. In addition, the color data and alpha 
hJ data may be RGB A encoded or "YUVA-Type" encoded. 

ri The various embodiments of the invention may be implemented in any conventional 

W computer programming language. For example, the various embodiments may be implemented 
4- in a procedural programming language (for example, "C") or an object-oriented programming 
f 1 language (for example, "C-I-+" or JAVA). The various embodiments of the invention may also 
be implemented as preprogrammed hardware elements (for example, application specific 
integrated circuits or digital processors), or other related components. 
25 The various embodiments of the invention may be also implemented as a computer 

program product for use with a computer system. Such implementation may include a series of 
computer instructions fixed either on a tangible medium, such as a computer readable media (for 
example, a diskette, CD-ROM, ROM, or fixed disk), or transmittable to a computer system via a 
modem or other interface device, such as a communications adapter connected to a network over 
30 a medium. The medium may be either a tangible medium (for example, optical or analog 
conununications lines) or a medium implemented with wireless techniques (for example, 



1247-A53-124004 
August 3, 2000 



.21- 



microwave, infrared or other transmission techniques). The series of computer instructions 
preferably embodies all or part of the functionality previously described herein with respect to the 
system. Those skilled in the art should appreciate that such computer instructions can be written 
in a number of programming languages for use with many computer architectures or operating 
systems. Furthermore, such instructions may be stored in any memory device, such as 
semiconductor, magnetic, optical or other memory devices, and may be transmitted using any 
communications technology, such as optical, infrared, microwave, or other transmission 
technologies. It is expected that such a computer program product may be distributed as a 
removable medium with accompanying printed or electronic documentation (for example, shrink 
wrapped software), pre-loaded with a computer system (for example, on system ROM or fixed 
disk), or distributed from a server or electronic bulletin board over the network (for example, the 
Internet or World Wide Web). 

Although various exemplary embodiments of the invention have been disclosed, it should 
be apparent to those skilled in the art that various changes and modifications can be made which 
will achieve some of the advantages of the invention without departing from the true scope of the 
invention. These and other obvious modifications are intended to be covered by the appended 
claims. 



1247-A53-124004 
August 3, 2000 



-22- 



We claim: 

L A video input system for pre-processing video signals, the system comprising: 

a video input module for receiving and forwarding one or more live video signals, the 

video input module producing a forwarded video signal for each received live video signal; 
10 a first video pipeline for pre-processing VS^, wherein VSj is a first stored video signal or 

one of the forwarded video signals produced in the video input module, the first video pipeline 

producing a first pre-processed video signal; and 

a second video pipeUne for pre-processing VS2, wherein VS2 is the same video signal 
¥ being pre-processed in the first video pipeline, one of the other forwarded video signals produced 
15 in the video input module, or a second stored video signal, the second video pipeline producing a 
nj second pre-processed video signal. 

HJ 2. The video input system according to claim 1 wherein the video input module further 
a comprises: 

^ an ancillary data extractor, the extractor removing ancillary data from at least one of the 

1^ 'i 

live video signals converted in the video input module. 

3. The video input system according to claim 1 wherein the received live video signal is VS, 
wherein VS is an analog composite video signal, an analog component video signal, a serial 

25 digital composite video signal, a serial digital component video signal, a parallel digital 
composite video signal, or a parallel digital component video signal. 

4. The video input system according to claim 1 wherein the formatted video signal includes 
D, wherein D is color data, alpha data, or color and alpha data. 



1247-A53- 124004 
August 3, 2000 



-23- 



5. The video input system according to claim 1 wherein at least one of the pre-processed 
video signals is e-VS, wherein e-VS is an RGB encoded video signal, an RGB A encoded video 
signal, a YUV-Type encoded video signal, or a YUVA-Type encoded video signal. 

6. The video input system according to claim 1 wherein the first pre-processed video signal 
10 is output to a storage medium and the second pre-processed video signal is forwarded to a video 

graphics processor. 

7. The video input system according to claim 1 wherein the first pre-processed video signal 
y is output to a storage medium and the second pre-processed video signal is forwarded to a video 
is output system. 

^ 8. The video input system according to claim 1 wherein the first pre-processed video signal 
fIJ is forwarded to a video graphics processor and the second pre-processed video signal is 
Pj forwarded to a video output system. 

ft 

4^ 9. The video input system according to claim 1 wherein the process of pre-processing 
f ^ includes changing the sample rate of the video signal being pre-processed. 

10. The video input system according to claim 1 wherein the process of pre-processing 
25 includes ganmia removal. 

11. The video input system according to claim 1 wherein the process of pre-processing 
includes gamma insertion. 

30 12. The video input system according to claim 1 wherein the process of pre-processing 
includes color space conversion. 
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13. The video input system according to claim 1 wherein the process of pre-processing 
includes dithering. 

14. The video input system according to claim 1 wherein the process of pre-processing 
includes scaling. 

10 

15. The video input system according to claim 1 wherein the process of pre-processing 
includes addressing on a frame-by-frame basis the video signal being pre-processed. 

y 16. The video input system according to claim 1 wherein the system is a Peripheral 
IS Component Interconnect circuit board. 

17. A method for pre-processing video signals, the method comprising: 
flj receiving one or more live video signals; 

f 1 forwarding the one or more live video signals, producing a forwarded video signal for 

if) each received live video signal; 

J~ pre-processing VS^, wherein VSj is a first stored video signal or one of the forwarded 

S video signals produced in the video input module, through a first video pipeline, producing a first 

pre-processed video signal; and 

pre-processing VS2, wherein VS2 is the same video signal being pre-processed in the first 
25 video pipeline, one of the other forwarded video signals produced in the video input module, or a 

second stored video signal, through a second video pipeline, producing a second pre-processed 

video signal. 



30 



18. The method according to claim 17, further comprising: 

removing ancillary data from at least one of the live video signals prior to converting the 
at least one live video signal. 
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19. The method according to claim 17 wherein the received live video signal is VS, wherein 
VS is an analog composite video signal, an analog component video signal, a serial digital 
composite video signal, a serial digital component video signal, a parallel digital composite video 
signal, or a parallel digital component video signal. 

20. The method according to claim 17 wherein the formatted video signal includes D, 
wherein D is color data, alpha data, or color and alpha data. 

21. The method according to claim 17 wherein at least one of the pre-processed video signals 
is e-VS, wherein e-VS is an RGB encoded video signal, an RGB A encoded video signal, a YUV- 
Type encoded video signal, or a YUVA-Type encoded video signal. 

22. The method according to claim 17 wherein the first pre-processed video signal is output 
to a storage medium and the second pre-processed video signal is forwarded to a video graphics 
processor. 

23. The method according to claim 17 wherein the first pre-processed video signal is output 
to a storage medium and the second pre-processed video signal is forwarded to a video output 
system. 

24. The method according to claim 17 wherein the first pre-processed video signal is 
forwarded to a video graphics processor and the second pre-processed video signal is forwarded 
to a video output system. 

25. The method according to claim 17 wherein the process of pre-processing includes 
changing the sample rate of the video signal being pre-processed. 
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26. The method according to claim 17 wherein the process of pre-processing includes gamma 
removal. 

27. The method according to claim 17 wherein the process of pre-processing includes gamma 
insertion. 

10 

28. The method according to claim 17 wherein the process of pre-processing includes color 
space conversion. 

29. The method according to claim 17 wherein the process of pre-processing includes 
WS dithering. 

Hi 30. The method according to claim 17 wherein the process of pre-processing includes scaling. 

b 31. The method according to claim 17 wherein the process of pre-processing includes 
%p addressing on a frame-by-frame basis the video signal being pre-processed. 

ii 32. A video input system for pre-processing video signals, the system comprising: 
means for receiving one or more live video signals; 

means for forwarding the one or more live video signals, producing a forwarded video 
25 signal for each received live video signal; 

means for pre-processing VSj, wherein VS, is a first stored video signal or one of the 
forwarded video signals produced in the video input module, through a first video pipeUne, 
producing a first pre-processed video signal; and 

means for pre-processing VS2, wherein VSj is the same video signal being pre-processed 
30 in the first video pipeline, one of the other forwarded video signals produced in the video input 
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module, or a second stored video signal, through a second video pipeline, producing a second 
pre-processed video signal. 

33. The system according to claim 17, further comprising: 

means for removing ancillary data from at least one of the live video signals prior to 
converting the at least one live video signal 
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ABSTRACT OF THE DISCLOSURE 

A method and apparatus for pre-processing video signals comprises a video input 
module, a first video pipeline, and a second video pipeline. The video input module receives and 
forwards one or more live video signals, producing a forwarded video signal for each received 
live video signal. The first video pipeline pre-processes VSj, wherein VSj is a first stored video 
signal or one of the forwarded video signals produced in the video input module, producing a 
first pre-processed video signal. The second video pipeline pre-processes VS2, wherein VS2 is 
the same video signal being pre-processed in the first video pipeline, one of the other forwarded 
video signals produced in the video input module, or a second stored video signal, producing a 
second pre-processed video signal. 
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Docket No. 
1247/A53 


Declaration and Power of Attorney For Patent Application 


English Language Declaration 




As a below named inventor, 1 hereby declare that: 




My residence, post office address and citizenship are as stated below next to my name, 


1 believe 1 am the original, first and sole inventor (if only one name is listed below) or an original, 
first and joint inventor (if plural names are listed below) of the subject matter which is claimed and for 
which a patent is sought on the invention entitled 


SYSTEM AND METHOD FOR PRE-PROCESSING A VIDEO SIGNAL 




the specification of which 




(check one) 




O is attached hereto. 




y □ was filed on as United States Application No. or PCT International 


Application Number 




and was amended on 


nJ (if applicable) 




Q 1 hereby state that 1 have reviewed and understand the contents of the above identified specification, 
m including the claims, as amended by any amendment referred to above. 


4- 1 acknowledge the duty to disclose to the United States Patent and Trademark Office all information 
Q known to me to be material to patentability as defined in Title 37, Code of Federal Regulations, 
O Section 1 .56. 


1 hereby claim foreign priority benefits under Title 35, United States Code, Section 119(a)-(d) or 
Section 365(b) of any foreign application(s) for patent or inventor's certificate, or Section 365(a) of 
any PCT International application which designated at least one country other than the United States, 
listed below and have also identified below, by checking the box, any foreign application for patent or 
inventor's certificate or PCT International application having a filing date before that of the application 
on which priority is claimed. 


Prior Foreign Application(s) 


Priority Not Claimed 
□ 


(Number) (Country) (Day/Month/Year Filed) 


□ 


(Number) (Country) (Day/Month/Year Filed) 


□ 


(Number) (Country) (Day/MonthA'ear Filed) 
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I hereby claim the benefit under 35 U.S.C. Section 119(e) of any United States provisional 



application(s) listed below: 




60/147,668 


August 6, 1999 


(Application Serial No.) 


(Filing Date) 


60/147,609 


August 6, 1999 


(Application Serial No.) 


(Filing Date) 


(Application Serial No.) 


(Filing Date) 



I hereby claim the benefit under 35 U. S. C. Section 120 of any United States application(s), or 
Section 365(c) of any PCT International application designating the United States, listed below and, 
insofar as the subject matter of each of the claims of this application is not disclosed in the prior 
United States or PCT International application in the manner provided by the first paragraph of 35 
U.S.C. Section 112, I acknowledge the duty to disclose to the United States Patent and Trademark 
Office all information known to me to be material to patentability as defined in Title 37, C, F, R., 
Jj Section 1.56 which became available between the filing date of the prior application and the national 
or PCT International filing date of this application: 



(Application Serial No.) 


(Filing Date) 


(Status) 






(patented, pending, abandoned) 


(Application Serial No.) 


(Filing Date) 


(Status) 






(patented, pending, abandoned) 


(Application Serial No.) 


(Filing Date) 


(Status) 






(patented, pending, abandoned) 



I hereby declare that all statements made herein of my own knowledge are true and that all 
statements made on information and belief are believed to be true; and further that these statements 
were made with the knowledge that willful false statements and the like so made are punishable by 
fine or imprisonment, or both, under Section 1001 of Title 18 of the United States Code and that such 
willful false statements may jeopardize the validity of the application or any patent issued thereon. 
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POWER OF ATTORNEY: As a named inventor, I hereby appoint the following attorney(s) and/or 
agent(s) to prosecute this application and transact all business in the Patent and Trademark Office 



connected therewith. 
Bruce D. Sunstein 
Timothy M. Murphy 
Robert M, Asher 
Samuel J* Petuchowski 
Harriet M. Strimpel 
Steven G, Saunders 
John J, Stickevers 
Herbert A, Newborn 
Jean M. Tibbetts 
Jeffrey T. Kiayman 
Jay Sandvos 



(list name and registration number) 



27,234 

33,198 

30,445 

37,910 

37,008 

36,265 

39,387 

42,031 

43,193 

39,250 

43,900 



Elizabeth P. Morano 
Sonia K. Guterman 
Keith J, Wood 
Karen A. Buchanan 



42,904 
44,729 
45,235 
37,790 



Send Correspondence to: 



Karen A. Buchanan 
Bromberg & Sunstein LLP 
125 Summer Street Boston 
Boston, MA 02110 



Direct Telephone Calls to: (name and telephone number) 
Karen A, Buchanan (617) 443-9292 





Full name of sole or first inventor 
JeffS. Ford 




Sole or first inventor's signature 


Date 




Residence 

122 Progress Lane, Madison, AL 35857 




Citizenship 
US 




Post Office Address 
Same as Residence 







Full name of second inventor, if any 
David J. Stradley 

Second inventor's signature Date 



Residence 

1025 Seina Vista Drive, Madison, AL 35758 

Citizenship 

US 

Post Office Address 
Same as Residence 
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